1 link tagged with all of: evaluation + preference learning + project swap + agent negotiation
Links
Anthropic ran an experiment where 201 employees brought books to trade, and Claude-powered agents negotiated swaps on their behalf. The researchers tested how well agents could represent people's preferences from short conversations and which factors—model strength vs. instructions—actually mattered for successful trading.
- Agents matched their person's book preferences 61% of the time based on just a five-minute conversation, suggesting AI can learn what people want from casual chat.
- The underlying model (Opus, Sonnet, Haiku, Fable) made far more difference to trading success than the instructions given to agents—stronger models produced more efficient markets.
- Most trading failures came from agents lacking good information about participants rather than poor negotiation skills, pointing to a core challenge: how do you verify an agent actually understands what you want?
project swap
agent negotiation
preference learning
evaluation